Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conformance testing for cosign #3806

Merged
merged 4 commits into from
Aug 6, 2024
Merged

Conversation

steiza
Copy link
Member

@steiza steiza commented Jul 30, 2024

Summary

Addresses the last P0 of #3139, including support for conformance testing, an e2e test, and some CLI warnings about incompatible flags.

Release Note

NONE - although maybe we should break #3139 into smaller chunks, and release the P0 parts of it while leaving the container image parts for a later release?

Documentation

N/A - see above

Copy link

codecov bot commented Jul 30, 2024

Codecov Report

Attention: Patch coverage is 0% with 199 lines in your changes missing coverage. Please review.

Project coverage is 37.06%. Comparing base (2ef6022) to head (3e3a61a).
Report is 180 commits behind head on main.

Files Patch % Lines
cmd/conformance/main.go 0.00% 189 Missing ⚠️
cmd/cosign/cli/verify/verify_blob.go 0.00% 3 Missing and 2 partials ⚠️
cmd/cosign/cli/verify/verify_blob_attestation.go 0.00% 3 Missing and 2 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #3806      +/-   ##
==========================================
- Coverage   40.10%   37.06%   -3.04%     
==========================================
  Files         155      203      +48     
  Lines       10044    12780    +2736     
==========================================
+ Hits         4028     4737     +709     
- Misses       5530     7453    +1923     
- Partials      486      590     +104     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@haydentherapper haydentherapper left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a few questions, this looks amazing, thanks!

test/e2e_test.go Outdated Show resolved Hide resolved
cmd/conformance/main.go Outdated Show resolved Hide resolved
cmd/conformance/main.go Show resolved Hide resolved
cmd/conformance/main.go Show resolved Hide resolved
Also add e2e test and some helpful error messages about what flags go
together

Signed-off-by: Zach Steindler <steiza@github.com>
Signed-off-by: Zach Steindler <steiza@github.com>
Signed-off-by: Zach Steindler <steiza@github.com>
Signed-off-by: Zach Steindler <steiza@github.com>
@haydentherapper haydentherapper merged commit fd0368a into sigstore:main Aug 6, 2024
23 checks passed
kipz pushed a commit to kipz/cosign that referenced this pull request Oct 21, 2024
* Adding conformance helper and Action

Also add e2e test and some helpful error messages about what flags go
together

Signed-off-by: Zach Steindler <steiza@github.com>

* Allow conformance driver to call cosign with user-supplied args

Signed-off-by: Zach Steindler <steiza@github.com>

* fix e2e test

Signed-off-by: Zach Steindler <steiza@github.com>

* Detail TODO comments; remove unneeded trusted root in e2e tests

Signed-off-by: Zach Steindler <steiza@github.com>

---------

Signed-off-by: Zach Steindler <steiza@github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants